Evaluating tag-based information access in image collections

The availability of social tags has greatly enhanced access to information. Tag clouds have emerged as a new "social" way to find and visualize information, providing both one-click access to information and a snapshot of the "aboutness" of a tagged collection. A range of research projects explored and compared different tag artifacts for information access ranging from regular tag clouds to tag hierarchies. At the same time, there is a lack of user studies that compare the effectiveness of different types of tag-based browsing interfaces from the users point of view. This paper contributes to the research on tag-based information access by presenting a controlled user study that compared three types of tag-based interfaces on two recognized types of search tasks - lookup and exploratory search. Our results demonstrate that tag-based browsing interfaces significantly outperform traditional search interfaces in both performance and user satisfaction. At the same time, the differences between the two types of tag-based browsing interfaces explored in our study are not as clear. Copyright 2012 ACM

The interplay between food knowledge, nudges, and preference elicitation methods determines the evaluation of a recipe recommender system

Domain knowledge can affect how a user evaluates different aspects of a recommender system. Recipe recommendations might be difficult to understand, as some health aspects are implicit. The appropriateness of a recommender’s preference elicitation (PE) method, whether users rate individual items or item attributes, may depend on the user’s knowledge level. We present an online recipe recommender experiment. Users (𝑁=360) with varying levels of subjective food knowledge faced different cognitive digital nudges (i.e., food labels) and PE methods. In a 3 (recipes annotated with no labels, Multiple Traffic Light (MTL) labels, or full nutrition labels) x2 (PE method : content-based PE or knowledge-based) between-subjects design. We observed a main effect of knowledge-based PE on the healthiness of chosen recipes, while MTL label only helped marginally. A Structural Equation Model analysis revealed that the interplay between user knowledge and the PE method reduced the perceived effort of using the system and in turn, affected choice difficulty and satisfaction. Moreover, the evaluation of health labels depends on a user’s level of food knowledge. Our findings emphasize the importance of user characteristics in the evaluation of food recommenders and the merit of interface and inter action aspects

Exploring the effects of natural language justifications in food recommender systems

Users of food recommender systems typically prefer popular recipes, which tend to be unhealthy. To encourage users to select healthier recommendations by making more informed food decisions, we introduce a methodology to generate and present a natural language justification that emphasizes the nutritional content, or health risks and benefits of recommended recipes. We designed a framework that takes a user and two food recommendations as input and produces an automatically generated natural language justification as output, which is based on the user’s characteristics and the recipes’ features. In doing so, we implemented and evaluated eight different justification strategies through two different justification styles (e.g., comparing each recipe’s food features) in an online user study (N = 503). We compared user food choices for two personalized recommendation approaches, popularity-based vs our health-aware algorithm, and evaluated the impact of presenting natural language justifications. We showed that comparative justifications styles are effective in supporting choices for our healthy-aware recommendations, confirming the impact of our methodology on food choices

Exploring the effects of natural language justifications in food recommender systems

Users of food recommender systems typically prefer popular recipes, which tend to be unhealthy. To encourage users to select healthier recommendations by making more informed food decisions, we introduce a methodology to generate and present a natural language justification that emphasizes the nutritional content, or health risks and benefits of recommended recipes. We designed a framework that takes a user and two food recommendations as input and produces an automatically generated natural language justification as output, which is based on the user's characteristics and the recipes' features. In doing so, we implemented and evaluated eight different justification strategies through two different justification styles (e.g., comparing each recipe's food features) in an online user study (N = 503). We compared user food choices for two personalized recommendation approaches, popularity-based vs our health-aware algorithm, and evaluated the impact of presenting natural language justifications. We showed that comparative justifications styles are effective in supporting choices for our healthy-aware recommendations, confirming the impact of our methodology on food choices

Charged-Particle Motion in Electromagnetic Fields Having at Least One Ignorable Spatial Coordinate

We give a rigorous derivation of a theorem showing that charged particles in an arbitrary electromagnetic field with at least one ignorable spatial coordinate remain forever tied to a given magnetic-field line. Such a situation contrasts the significant motions normal to the magnetic field that are expected in most real three-dimensional systems. It is pointed out that, while the significance of the theorem has not been widely appreciated, it has important consequences for a number of problems and is of particular relevance for the acceleration of cosmic rays by shocks.Comment: 7 pages, emulateapj format, including 1 eps figure, to appear in The Astrophysical Journal, Dec. 10 1998 issu

A day at the races : using best arm identification algorithms to reduce the cost of information retrieval user studies

Two major barriers to conducting user studies are the costs involved in recruiting participants and researcher time in performing studies. Typical solutions are to study convenience samples or design studies that can be deployed on crowd-sourcing platforms. Both solutions have benefits but also drawbacks. Even in cases where these approaches make sense, it is still reasonable to ask whether we are using our resources – participants’ and our time – efficiently and whether we can do better. Typically user studies compare randomly-assigned experimental conditions, such that a uniform number of opportunities are assigned to each condition. This sampling approach, as has been demonstrated in clinical trials, is sub-optimal. The goal of many Information Retrieval (IR) user studies is to determine which strategy (e.g., behaviour or system) performs the best. In such a setup, it is not wise to waste participant and researcher time and money on conditions that are obviously inferior. In this work we explore whether Best Arm Identification (BAI) algorithms provide a natural solution to this problem. BAI methods are a class of Multi-armed Bandits (MABs) where the only goal is to output a recommended arm and the algorithms are evaluated by the average payoff of the recommended arm. Using three datasets associated with previously published IR-related user studies and a series of simulations, we test the extent to which the cost required to run user studies can be reduced by employing BAI methods. Our results suggest that some BAI instances (racing algorithms) are promising devices to reduce the cost of user studies. One of the racing algorithms studied, Hoeffding, holds particular promise. This algorithm offered consistent savings across both the real and simulated data sets and only extremely rarely returned a result inconsistent with the result of the full trial. We believe the results can have an important impact on the way research is performed in this field. The results show that the conditions assigned to participants could be dynamically changed, automatically, to make efficient use of participant and experimenter time

The effect of diamagnetic drift on motion of the dayside magnetopause reconnection line

Magnetic reconnection at the magnetopause occurs with a large density asymmetry and for a large range of magnetic shears. In these conditions, a motion of the X line has been predicted in the direction of the electron diamagnetic drift. When this motion is super Alfvenic, reconnection should be suppressed. We analysed a large data set of Double Star TC-1 dayside magnetopause crossings, which includes reconnection and nonreconnection events. Moreover, it also includes several events during which TC-1 is near the X line. With these close events, we verified the diamagnetic suppression condition with local observations near the X line. Moreover, with the same close events, we also studied the motion of the X line along the magnetopause. It is found that, when reconnection is not suppressed, the X line moves northward or southward according to the orientation of the guide field, which is related to the interplanetary magnetic field BY component, in agreement with the diamagnetic drift